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ABSTRACT 



The kernel of the Angoff method of standard setting (W. 
Angoff, 1971) would seem to be the judgment of whether a minimally competent 
person could answer an item on a test correctly or not. So it would seem that 
any procedure that requires independent judgment of the correctness or 
incorrectness of a response to items for a minimally acceptable examinee 
would merit being labeled as an Angoff method. Standard setting methods that 
use the Angoff kernel can be quite different in practice, but they may be 
given the same label in the literature on standard setting. The kernel for 
the modified Angoff method is not well-defined, but for this paper, it is 
defined as judgments of the proportion of correct responses for minimally 
qualified examinees on each item on a test. A look at the American College 
Test/National Assessment Governing Board (ACT/NAGB) standard setting process 
for 1992 shows that the definition of the kernel has evolved into something 
that only contains the essence of the modified Angoff kernel in the first 
round of ratings. Once the holistic information about test and item 
performance is provided following round one, it can no longer be argued that 
panelists are performing independent item-by-item ratings. Labeling a 
standard setting process by the summary description of the kernel is no 
longer adequate. The ACT/NAGB method is a multi -round process with a modified 
Angoff kernel for the first round, holistic feedback, and normative 
information for later rounds, and direct specification of cutscores on the 
score scale in the final round. (Contains 12 references.) (SLD) 
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